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ABSTRACT 

This document was compiled for the Participative 
Management Program at St. Louis Community College. It is composed of 
four parts, each dealing with an aspect of evaluation of objectives. 
Part 1 / An Introduction to Evaluation, discusses the difference 
between measurement and indication, the three general evaluation 
types (internal data, surveys, tests) , their dependability, and the 
conceptual steps, tactics, and application of the three types. Part 
2, Program Evaluation: Quantitative Methods, discusses human and 
theoretical problems with quantitative data, defines levels of 
measurement, and illustrates sample objectives measured at different 
levels. Part 3, Introduction to Attitudes and Attitude Measurement, 
defines attitudes and their cognitive, affective, and behavioral 
components, discusses functions of attitudes and. a rationale for 
their measurement, describes characteristics of attitudes and 
behavior, and provides guidelines for measuring attitudes through use 
of examples. A general discussion of attitude measurement and the 
expected value to educators is included in this part. Part 4, 
Evaluation of Support Department Objectives, discusses objective 
formulation, emphasizing the writing of measurable objectives that 
are realistic, attainable, and focused on results. It is suggested 
that the writer of objectives decide on a quantitative standard, 
define the audience, set a deadline, and determine the mechanics of 
measurement for each objective. (JDS) 
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PART 1 

An Introduction to Evaluation 



This introriui \\nn \o nvjiu.ilion is iiUfiidiH.I \()Si/ggest possihh' ii|)()i()<n';tu;s to i-vJiliMlicm lh<ii h 
1)1 . Mip wniif Ml < iljjt*' livrs iuny wunt lu < onsidi'i . S>onu; f.itij(M. lives fnny Sfnfn so irnfxjr tiinl HujI s^'vcf.i! 
(ill f^'icnt f'VMhMliuri r'uMhorhi will (.tiosfjn/ vyhili.' .il ihi? otIuM ijxlontip, sonu.i ul)i(it:tivi'S ni.iy S(j(Mti 
so St!* nfid.ifv "I l.ioqriitiji to .1 ()ruiifi''; f loriiosc .r; to not Wijrriint (nMlUfition iit till. Moo-ovmn , sonu^ 
ot»i(M lu'r-s riMv I"' Hi?»'ni(f(l wortliy of '!V,ilii;)lion ovi'iy s(Mi)o:;t<,'r . whih' othiirs ium.'cJ dv.iliMliof) only 
('Vf»ry low y'Mfs. f in.iliy, tin .jpproprialtr *iv<ilu<ilion t<H hrii(iu(? ni,iy (Irl«?f ininrcl thj- h;) l)rii{ji,n 
in.jy fic too ^ i.istly (rTi(.)i((;y , fjfopic or tinti.O \o iiiiisur. 

I. Measurement * or Indication **? 

If tfiM iiu'ttKMl ol rv.ilo.ilioM J }io';('fi i:> rxpn iJ'fl to f^i i-'citH ;in cx.ict stiit^Mimot of oinplisliiiHint 
U>f an ol)jf( iivi! or Mnfjlrrnf.'nt.itioii »iviMit. tlK-n it siioiik) hi? \\tA('s\1]S measurement, whi( h would rrujiin 
It is ('\pt»(.lk.'cj ho .11 i.iirnt*' way ui fntMSurinc) tfn' t)hj('( tivu. 

But if .1 rM»nhod doon fiol fni-dsurf; tfio onifflishMinnt of till of <in obifft.tivii. or if ih^; nu.-ihod is not 
It'll to ht' ( Mfnpli»toly ,1(1 iir.ito, it should listed c\s indicator. This would inr-an th;U it (l(?srrib»fs 
';(jfn''tliiii(| iihout tfi»; .h roiTiplishrn».'nt of jn uhjcc tivfi, hut not jll that nojids tt) b(? knowri. 

II. The three general evaluation types are: 

1 . Ini^'rn.il (J.ita • d.ita that is alONidy t oll»'^:ird 01 whose; < ollfM tion (.an in? s(.*t uf 1 ,ir-; a 
f ' )uriin} I Inrn a! fuiu tion, Kxaiiiples. 

(jradH rijports 
riirolhnent fi(iurt'S 

at tendiinci' counts - for liljrarifjs, lahorattjrios. offices, social and athh.'tic cvciiits 
r ash niyister rtu (.'ipts 
nufubor of telephone calls 

nuinbt;r of complaints, lf:lters of coniinendation 
number of donati(jns, amounts of donations 

2. Surv{iys - resf)ons(?s from rjraduatos, formfjr students, prt^sent students, pros[)e(:tive 
■■tudents, nmployees, iidvisory hOcjrd members, and local residents can be solicited throucjh 
si.:rs/t>ys r:onducted oithfir r(^(|u!arly or ot.casionalty. 

3. Tests - mental iind physical skills, niemori/ed inf(Kniation, and task performance can Ik? 
evaluated by askinc) students, cniploycos, file:, to answer cjuestions or do a task. 

* M(.vjsun?rTif>nt - usf^i for those object- ves for wfiir:h precise quantitative and qualitativ(.' standards 
can be det(?r mined. 

Indicators - used for those obiectivfis for which some data can ue idcjnlified which provide indications 
of achievement. 

III. How dependable are any of the above types of evaluation? 

Their depend<ibility is a function of how accurately data is collected, how appropriately it is analyzed 
and how carefully it is interpreted. The number of people who call the college president to con^plain 
or compliment may be an important number, luit it can't be interpreted as an accurate evaluation 
of attitudes throughout the community. 

Similarly, SLirvey responses may not be entirely honest, may not come from a sufficiently larcjo 
and representative group, or may not reflect an adequate understanding of the questions asked. 
The validity and reliability of particular tests must be established here within the college. Tests raise 
the additional problems of nervousness, illness, and poor test-taking skills. 

Considering these drawbacks and other potential hazards, the first rule of evaluation, matter what 
method is used, is that results, even if expressed in exact numbers, are. approximations. All too often, , 
however, this is forgotten, because the precision of numbers is intellectually seductive. 



2 



3 



Of It ' vv-iv « »^ iv< ii' iif I'l •[)' • ti lip 'if ()i vin<i \iu ) M)W(.h ( f'clcfii c tt i ,i | Mr ti( iil«'if of niif rthfis r> to ii'it; 

<\conU)ination of .'v.ihi.ition t-i.-thiid-. I /; mji 'iim»i.' dif N-irfit tfsisor combined vjwU scim<? 
iiih'Mi.il (l.it.t will pu'.sihly 

1 . . ji i'.t ■ I H 'Of -I' ' ti) p. ii j'.f I »' 'tof jun:( (ir u| l( ) ,1 ' oi)i lu'iioi I I )<isprj » nt si? I of <;♦'( !i nidfjly 

( >f t'' f t "iul t'. 

ot {',<'! th'f i h.HJi »■ uf . I f M )( »f iy < i)f u (>ivt;( I or < ollStfl H !<•( I f'VMllltllioil niiitfiofl luiV'fKj (oo 

Tfi" p'olilfrii vvi III Mil \) ■ I iMiliifi.itiol"; 11, tli.it tlniy .irc iDiifuv.ioii (o work vvilf), hut [HMliaf)S our i :f)[)irH] 
vVilh su'. h ( onfiiMoii will lf<i(l ir; t< i nu'lfioil'. <>j M\./;ilii,i(ioti !h,)t Wf- trust ,is (joncrjily ii( ( urrjifi. Tfi(] 
.jltt'f n.niv*.' is to s^'.in h f r i irth.'ssly for sirnplc .insv.oM:; to i ofn(il»'>; lllll'sIi()^^s. 

IV. Conceptual Steps toward evaluation: 

1. \\v fifst stt'c i-i 'l«?^inin<) thfM)l)ii;i livff. th: liof^tMi-tor (jncl irisult. This process is iilroiidy 
Vvr'I ujifkrrwuy . 

?. i >'>'r, till? slf.'ps th.it liMcl lo th».' objiM tivfl n*' m.1 to h(; dcfiiifd. Thci wriliiK) of "ifM[")l('fni!ntnlif)n 
♦ v>'f its" ' -Hi \)\' s<M!n .IS SI K.fi »i (.i(:f initioM . 

Throti(jh(.»ui th»J pioc»'ss, (Jcfinilioo of irnf)lnfH'nt<ilton (!V(?nts nfMjds to bi? rovi(fW(;d, 
sirv 1} ,10 ifn[)li:riiont,.ition ev»;iit , fuily <if f. on »[^lisfi( id, miiy in? found to h^'. incf f(]<:liv»J in 
,K f rMnjiltsfiinf) tfi<} o[)je(,tiv(?- Suc fi n'vi»'W i;<in be likf-'fuid to tiu^ forrnal proc.oss known 
"s(j'' i:«'5isiv<? <i[)[)roxi rn.iiion". 

'I. Firhjlly, the st.iriint) [joint or [)r(rsoni I(.'Vfjl of dfcornpiishnicnl nt.'f'ds to b(i dotorminod. How 
nvjny poopl*:- bfMjin ,.i f)r(.K.jr.itti, ul whut "(.'nlry I'JVfil"'' 

V. Tactics for the three general evaluation types: 

1. Int«.'rn<il d^itii ((pintjr^il infornvnion ( ollcct'id on ci oifjokir biisis) ru.u.'ds to be f)rf!se?nt<:d 
( If'^jrly. Ofu.' wjy of doiruj this is ronstructing (iraf)hs or othur visual dispkiys th^l nmy 
rf..'Vf'.;il rrnjr^; thiin thfi niinii)(;r*j dlonn would. 

?. Snrvtjys iirt; rf]C|uf.'Sts for inforni;ition iind attitiidfjs. Tliff considorations involved in 

t onstructinfj .irui ijdministoi inf) .i surv*;y that will ixf both valid and reliable aro hicjhiy (;(jinplf?x. 

Tor altitudinal nuMSurcrnijnt, ihrcJtMt.'f hnifiiHjs aro (j(?n*!rally a(.(.f>'[Mod: Lik(.Tt Scales, 
Osgood's Sr'rnantii;' DifffjrfMUiai, and Thurstoru.' Sfialos. Tht^sti te{;hni(|ur?s are (jxplain(.d 
on pp. 17-21 of the Guide for Evaluation on reser'Vfi at fiaoh library. 

Fof further help on surv(»y <:onstrcif:tion and adrTiinistration, f;onsult with th{>' fufiowinf) dean^]: 

f^'te Hirst h Florissant Valley 

Ron Lmrjle M-»'rariu!( 
Lana VV(?inb<if;h Forest Park 
3. Tests t.<)n be written. or<il, or task [)er fori nance (or a f:oin hi nation). 

a. Writtfir^ tc»st:;. whethfir "objf:(,tiv(?" or "open-ended" demand that \\mi tesl-tak(;r respond 
rif)pro[)riat(?ly to a qut.'Stion or coinrTtand. so the* first reiCjuirtiiTient is that questions and 
«.oniniands be ( lear and unarnbic|(jous. T(?st-takers shfjuld be led to believe that they 
ean perform well on the ter^t; (jtherwise, their fears of failure may obstru<.:t their doing 
their best. 

I). Oral and perforniance test qt'e'Stions or commands also nejed to be clear, but the» 
tesl-takfir has an ofjfjortunity \o request clarification when needed. 

c. Performance tests (ty[)in(j, shorthand, athleti(,s, drama, laboratory techniciues, etc.) 

involve a f>roblem tfiat can best be described as "stage-fricjlit". One way of reducing this 

is to cjive several opfjor tun i ties for the same test. 
This discussion of tests is [)urpQsely superficial. Until more is known about test -taking, 
catition rTUJSl be the by-w^ord in tcst-tnaking. 
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U\ .KlcJitton It) tho cU'.i\ns fiiiintHjru'd eilMjvc. {\v' fi.)llowi()() (njur^l*; in.iv ini ubliJ to holp with 
t»'sl I oiistnif lion 

Phil C<irl.)t,k Fonisl P.ii^- 

B()l) Rii.hrv f"()r»JSl Pml' 

B*fnv DuvdII ri(;risS(int V.iM<'V 

Jim P'\nru) MorjinrK 

VL Specific Applications 

It is difti( tilt to i honsn .i ( ollrtic oi t»fo»)r.iin oh'ifM.livf' Jnd Sucjtlt.'St hnw it inicjht tju fJVciludtctl without 
Sfjoiniiifj lo ho cli< t.itiin; to ( (,)ll*;(i<t oi fuoiliitin. 

For sooqestitjns th<Jt you .iro ontiidiv fn^* rt?j(M t. s»?f? lh»,' Guh/e for Evaluation, 
})p. 29-42 proiir.iin (jl>jn''ti vfS 
i>p. 43-B3 ^)ncl 

A()[)i;ncji>; A colhuif! ol>j»M,,tiv(!S 
F(,r rnnrt; M KUKistions. it niicihl produr livn to invito i\ sfii.jll groufi of p(;Of)l(^ from othdf pro()rdiM'; 
within thf; <-oIKm)0 or from ulhor f:ollo(;f>s to ;jiv»' tho'ir idods on ov^lhJ^ltin(l u spooific obj(M.tivo. Tlioso 
<!o»':^.t iniorviows miqht toll <\ pro»)i^im or c (>llof)o writiiui toeim how thcnr objootivos ciro boinij rfjiid 
by others, jn(J how olhf?rs vi^w llirir rol(.' ifi tfuj totiil (?ffort of St. Louis Community ColhKjo. 



4 



5 



PART 2 * 

Program Evaluation: Quantitative Methods 

Jainos O'Gnnly 



INTRODUCTION 

P.irl I ot ttiii; hiindbook notod thiil soriio proi|ri.irn objj.'ctivos iiiny sooiii so iiiifiortant thiit wivornl difforont 
♦ jvahiriliDD fiiethocJs will Im; i hosLTi, whiln ill otfujr cxtriMiui, soiiuf progrddi objofitivi's iiiiiy sl'OD) 
so <j(M:nndiify or l.inyfjnlinl to d ijroup's puriiostj to not Wiurnnl (iViiluntion tit ,'ilL For thoS(j (JnpnrtrruMils 
who Wfint to oviilualii progriuii objcjcMivfts (luanlit.jlivtilv, Ihd following Informntiori rovtiriof) [)robl(jnis. 
lovtHs of iiKMSuruiiKirit, iiod spoclfic exriiTiplos, fnay bo of h(ilp. 

L Problems with Quantitative Data 
Human 

1. Bias ' PtMsistLTit e^rror in onfi direction during th« c;olltH:tion proa.»ss. 
Omission of important fa(:tor(s) - Omitting signifiaint informnlion. 

3. Cif(.'l(is'',n(i5is - Error introduced through improper colkjction, analysis and intorpretiilitJn. 

4. Noivse(|uitur - An infcircnce that doys not follow from the prumisr^s. 
F). Non-conipjrablf] data - Comparing unliko mc;asur(?s. 

6. Confusion of association with causation. 

7. Poorly (i(]sifjned f.'xpf.'rirrHjnt. 

Theoretical 

1. IrKSuificient data - Adequacy of sample nuiriber. 

2. Unrepresentative data - Adequacy of sample relative to population, 

3. Coneealtid classification - Sub-groups in population weighting population. 

4. Misleading totals - Combining unlike values. 

11. Levels of Measurement 

When data are being collected, the process of assigning a value or score to the observed phenomenon ^" 
constitute)S the process of measurement. The rules defining the assignment of an appropriate value 
determine the corresponding level of measurement. The different levels are distinguished on the basis 
of the ordering and distance properties inherent in the measurement rules. Knowledge of these rules 
and their implications is Important to the ovaluator because various statistical techniques are appropriate 
for data meastired only at certain levels. 

Tlie traditTonijU;fnssification of levels of measurement was developed by S.S. Stevens, He identified 
four levels: nominal, ordinal, interval and ratio. A simpler classificatron than Stevens's Is to divide 
variables into quantitative and qualitative types. Quantitative variables are those for which a fixed unit 
of measurement is deflned-essentially variables at the interval and ratio levels. These are the 
variables for which the most powerful and sophisticated statistical techniques have been developed. 
Qualitative variables, then, are all others-namely, those at the nominal or ordinal level. 
Another distinction, which can be made based on levels of measurement, is between parametric 
(or quantitative) and nonparametric (or qualitative) statistics. Nonparametric statistical procedures 
require few assumptions about the distribution or level of measurement of the variables and may be 
applied to nominal and ordinal data. The parametric procedures require more stringent assumptions 
concerning the distribution of the data and are designed primarily for data at an interval or ratio 
level of measurement. 

Stevens's four levels of measurement and examples are presented as follows: 

1. Nomina/ or classificatory class - Measurement at its weakest level, where numbers or other 
symbols are used to identify groups to which various objects belong. The scaling operation 
is partitioning a given class into a set of mutually exclusive subclasses with no high or low point. 
For example, we place graduates into distinct categories by program. Art, Business, etc, and 
do not imply that one Is "greater than" or "better than" the other. 



6 

5 

o 

ERIC 



Ordinal or ranking scale • Ai nofriin,)! I(?vi}l, (3l.)j('(;ts in owv ciitociorv o \ w sctdr iiir ^hown 
\o Ik.' (litftMrni froin I ho nhji-* Is in olliiir cattMjorif..*'; of (fuit sciilo. At tho urdin«il Irvol, tl)<; 
(>l)jM<:is on.' (liltf.'r(!ni jrici lluiy sliHU.l ifiiioirm kind of rcK'jtioti to Wuuw, Tv('i' «i' rfH.ition'* (imonf) 
( ltisr.(."i iirr f)i()lii,'r, int>n.) [>ref»Tr(Mi, in(.)r'.' iliffi* \'r!t, moK; (Jistur'h<Kl, more* iihiturfi, I'ti . Tlic 
ordifVil l('V(.'l ()(>()!; Ii,iv»' u tiKjhf.T .ind lovvffr point hut liJrks (miikiI intcrviils, Fcjr I'X.nnpN;, vvc 
niviy ( Kissify fiirfiili<J!; of ()r<iriiicit(;:i .k ( <)rtiin{) to soriotn onoriitc r.tfiliis uf)pnr, u(^p<fi irmj(Jlf\ 
lowor-mickjln, rintJ lower. Wo know only thnl om? ir> (jniiuor or l(?r.Sf}r than .inotlior hut ( nnnol 
s.iy how ftiuch ()rf'iitr?r or I(;ss(M . 

'\ Interval Scale ■ At thi^, hiiiht.T Il'VoI of inrnsuroinont llio clijirnf.loristit.s of hignor tind lowrr 
points iUii prfisnnt .nui in .nkJition tlio clisiuni.r.'S hotWfir'n unv two nuiTihors on th(! sculo an? 
of known si/o. hlowcvcr, ilio /oro p(.)ifii (jncl tluf unit t)f iiuiosurcMiiont urti ,irbilr,iry. For <.'xni!ipl(? 
.in .■ictidt'fnif: (jrad(J point cnn be consichirocJ nuMsurnrnont on the intiirvfil InvcL 

'\. Ratio Scale - At this hi()fu.!St li;v(jl of inenSLircMTifMil, .ill tho (:hcira(:torir.lii:s of nn intcrwil r.c^iln jr»,) 
prosL'nt iind in addition it hns ci trun /uro [joint as its origin. Noriiuilly , por cjmU rm'nsnrf's iirt? 
on th(.' ratio scale. 

Ill, Sample Objectives Measured at Differing Levels 



Program Objective: 



Levels of Measurement 

Nominal 



To ruduce the niiriijon 
rale in the An Program. 



Classify students by who 
completed and did not 
complete program- 



To improve student 
appreciation of music. 



Classify students by 
indication of appreciation 
or lacking an appreciation 
of music. 



To serve persons 
requesting counseling 
services in a courteous 
manner. 

Surveys of students 
will rate counseling staff 
favorably on this 
objective. 



Ordinal 



Classify and c<)tegori2c 
students not completing 
program by possible 
variables, i.e., outside 
employment. 

Less significant, sigr^ificant, 
and more significant. 



Classify and categorize 
students who indicate an 
appreciation of music by 
possible criteria i.e., 
knowledge of composers. 

Completely unfamiliar, 
familiar, very familiar. 



Surveys of students will 
rate counseling staff above 
average better on this 
objective. 

Inadequate, adequate. 



Interval 



Evaluate and Categorize 
students not completing 



Evaluate students who 
are unappreciative of 



program by academic grade music by a score on the 



point. 



MAT. 



Ratio 



Evaluate students not 
completing program by 
student credit hours of 
enrollment. 
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PART 3 

Introduction to Attitudes and Attitude Measurement 

John Miikiivet/ 



\, Somu Definitions of Attitude 

A, An iillitiKh) is d mk iil.il .ind Drnir,)! sMlt^ of rfijdiiu";';, ()M}(ini/t»d through oxporiuni 
ififliMMK ini) <in iiidi vicjiiiirs rn'i|n)nst! Xo dH i>l)j<.M ts lUul sittiiitli ins wilh \,vhit:h it is r't.'Inlnd. 

B. An .ittitiidtJ \\y <ifi idr.j i fi,)f(|t'(J witf) (iinotion vvhi(.l'i prodisposfjs ,i rljs'; of ,M;(i(.ins to d 
p.'irlM.uUir cliiss of sot.i.il si t Uii tit ►ns. Altitoduf; linvi* tfirfi; (:oin()ononts, 

/. Cognitive < oin(.)on»Mit • Jin idt^a or f:ofn:ti()t 
j'xjinpli,'; St. Louis Coinniunity Collono 

2. Affective {cmotiun.il) comfioiuint .in <^v,ilualiv(; ((jood-lhid) Uibul 

•jXijiiipli!, St. L,ouis CoriifMunity Collr()i! is fjood iind Viilunijlt' to thf (.ommunity, 

3, Behavioral <.onipnru!nt ■ a prodisfjosilion tn (let ion {j;».'okin(j-,ivoidirui) 
iJXiifiiple: St. L.oiiis Conin>unily Colk.'cii: is fjood tind viiluiibl(\ Th(ir(^f(.)r(i. I 

probably f;ur)f)ort U.HjislrJtion which wtxild )irovid<i n\o\'v. rasourc(-'S for 
tho Colh.'()t>. 

M»-.isurinf) attitudiis involvtjs monsurintj stcJtumonts nbcKit btihefs or cotuyori/ntions (cotjnitivfj 
' « >i!ip()fHjnt) , st(jl(.'rnf;rits iiljout emotions or »d ftjulincjs (,if ftjctive {:w\\^onrAn) statements 
iictifjns (iMih.'ivionil c:ornpt)nent). Thu fjredifitod bi.'finvior is not quijrant(3<-^d, 

II. Functions of Attitudes (Why ineMSun,? .jilitudns^) 

A. Atrttud()s holp (3f>bpl(; to iincjtJf stand tfiu world around thciii, by organising, cat(K)ori7inc|, 
and sirrif^lifying the cotnf)lfix and soiriRtirnes confusing input from the onvironrnent. 
Attitudes provide an overlay of PREDICTABILITY to our world, 

B. Attitudes fielp people to protect their self-esteem, by making it possible to avoid 
unpleasant truths about themselves. 

C. Attitudes help us to maxinii/e rewards from the environment, since we get along best 
with people who have attitudes similar to the ones we hold. 

D. Attitudes help people to express their fundamental values (Where do you stand on the 
abortion/right-tt)-life issue?). 

III. Characteristics of Attitude and Behavior 

A. Attitudes and behavior interact and are interdependent. 

Attitudes and behavior affect each other and are affected by each other. For example, 
a student who has negative attitudes toward the study of philosophy may avoid lectures, 
[if)oks. and courses which deal with the subject. If the student finds that he has to take 
a philosophy course to fulfill a degree requirement, he may, through first-hand experience 
with the subject, change his attitudes toward philosor)hy. He rnay sign up for another 
philosophy class, do sonie outside reading, a()proach his other subjects froi^T a different 
perspective. The feedback 'loop continues, as the student's attitudes change even more, 
to the point that he recommends philosophy classes to his friends. 

In an alternative example, the presentation of the philosophy class may convince the 
student that his original attitude was correct (the attitude is reinforced), and no verbal 
or behavioral change will result. 

B. Attitudes and behavior are situation-specific. 

In a classic exarnple, hard-rock coal r^iiners in WbSt Virginia demonstrated strong racial 
prejudices above ground. Within the mines, though, discriminatory verbal statements 
and overt behavior did not exist. The dangers of working in the deep mines and the 
necessity for cooperation and trust produced a temporary situation-specific attitude change. 
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(,:, AtliliiihM. riri' IiMf iicil, 

Altituil»fS I .in Im' (tiodilii il jinl « li,iin)uiJ..at cijicjirut lo itn) (iriin iplcs of !iMrfiiiP) ihi'diy. 
IV,!' fiimi irivoivvf l < fiJii<|in') <int»'tili?';. f'Mi Dx.iniphj, in ,i jujcnitiifiiil firoiiriiir^, ,1 sun lent 
ttuiy shuw iiH M'.iMJ<l liUfM.ini (' in tyfiiKi (Hid nthn l)ii!.iiu'!is iLissi?:; iivnr nninlM-f i il 
!;rin.v;ti'i!;. It, tn jvvt!vi;i , lln; Mntl^'iil'', Httiludc tnvv.ird ^i vr.y MM.in.il m cnp.itiun 1)(m mum-, tnui 
,.ind mom n<MiJtiv(; t)f!( uust! ot [hv. iihpurson.il ,iful miu tijuii ^il vv.iy tfm ( oiif sivi \\m) t.iiM)ltt, 
h«i or slu' II). ly ";h,in<|(? niiijors ,m\ |.mii<.i.;*.' <i dilhin.'n! (M:c:upi»ti()n. This Would ho ,1 vv«i'.ti' 
iif timoiind fnonf'y for Ixuh th«' student iind th(! dop<)rtmi:nt involvfd. Altoniiiiivrly , 
ltM» sltril<'nt in.iy i|u into siM rct.ifi.il vvi •! \. , .inri hiM.jiisc of intcMiso fiiM)jliv(^ iiltitndr'S, do .1 
pool |oh. 

D. At litudtif; firodisf^osc l)»:hdvior ,iloni| d i.onliimuin, lioin 
Givini) simple (iivimi Ciiviiuj stntcv 

stdliMMiMUs ol ► sl.itiMiK.'nts ► munti; aboi It ►F'^rosely li/iim 

,i()r«HMn»;rU or of support futurf.i iu;tions 

n.s o()nitiofi 

IV. Measuring Attitudes 

A. SoriK? qiMfi titles to ( onsi(i(!r in Jt titude fnciisuMimcnt 

1. ^AHlnitndo - HoW much^ 

2. Frequt.'ncy ■ How rn,ifiy hlow ofton? 

3. L.itoncy - How \oU(] would il U]ka hoforti somk) oction t)(:(.iirs? 

4. Fxtinr:tion - How loiu) will tho nation cootinuo, unrtfinforaxi-^ 

B. There .Kti m.iny techriicHJ^JS ond instrunu^rits cWciiliibU? for uno in mcvisurini) iittitiidir)<il 
ohj(!( tiv«;s. Rntinr) Si;aios, quostionnairf?s. chtM:!-; lists, and attitude - U)adod ohjectlvif 
tests itiay be uswJ. Set.* thcf attached (ApponcJix I) Informal Criteria for Attitude 
Statements (Girod. 1973) for somo quidelines in writincj attitudinal 

tlt?fi?r,. In gerifiral, first selof.t major constructs, ideas, or concopts, then writo as many 

ilpfiis as possible rcolatfJd to those constrtiets. 

Fxamf)U; Proiiram - Management and Supervisory Development 
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Behaviors 


Measurement 


1. 
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la. 


T(j itnpiove attitudes toward 


St£iteinents of willinijness to 


Before and after measurements 


women and minorities 


work wi th, pr(Dfnoto, cjivo 


usinc] Likert-type items 




raises to, cjivo increasod 


(always/never, strongly 




responsibilitios to women 


agree/disagree;). 




and minorities 


b. 




b. 


Use of Semantic Differential 




Statements of willingness to 


Techniques lo measure 




fixplorc the problems woiTien 


changes in Ss concept 




and minorities have 


structure. 
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historically had in industry. 


2. 

Before and after use of a 
rating scale requiring Ss to 
rank a series of activities 
according to Ss willingness, 
to participate in them. 



C, Ml'' |tinh)(Mii 1 1\ )i I, illy ,n ( pptiil'K* r»':;()(,i(isi':) on psv" fu»l()i|i( iil l«!};ls is vvidl riM:()<|iii/i;(l. 
V.irnMi'i II "ihod;, f),ivt' ht'ch i|<'vi'.<'(| Id i (jfUinl fi)f thn; piohldiii in altitudu tnsuiin h. 

^ii ifnr ,if r (list u'iS»'(| firi»'. 

1. jtic nMiniriMin c ol fmiH':,! ,iii(j npffi ( i ittiiinii it( .ilioii ln'twoni sliKicnls iiiui toj' Mr 
will dttf MMSc ilic h'lulrni y f(jr •.Unh'ttts l(i ')ivo iIm) iii)!Avnrr» thny ifiifiK thi; h^K.lit'f 
wjnls. 

V. M.iU' .1 pMiiit ot r»M|(ii'!itiru) liDfio'it, ftisl iiiifirtission rt?sponr.(!i., 

r,, I ifiiii [\]r riKioiiri! ni tinic slyrjiiiils sptMit) Um) cviiliMtiofi Instiiiini nlfi. 

4. It jt .ill ()nssihlL\ ni.iiiitilin tfte :;t<i(l(inls* cirKjiiyiiiity, Ir^siirc Ihcir rif)hts to priv.n.y. 
Attitiicj{?s ur(! intrn.iti'ly fn.'Ul.antJ will \)v ifujrc ruiiiifstly (livulijL'fj in non 
Ihrniilenifif) sitiiiiticuis. 

!i. Allnin.itivnly, toll \ stutldnls nXcK tly whdt you <ir(} inniisurinc) iind wfiy, toll 

tfw.'fn th.it of your uhjn( tivos is to chtiinjo iittitudes, iind invtjlV(j th() studf?nts 
directly in ihu nvakuition procnss. If doni; 5onsitiv(jIy , iiwolvornont in tho nttiltidi? 
r'io.isnr«;nufrit prorf:duro nuiy (prohiibly will) \\\ ils(?lf s(?rv(? to cht'intjo ntlitudj's. 

D. An o.Xcirnpl(; of .in dtldndi! nKMiiiiromnnt study usiiu) tfie S(irn;.irUit; Di fforontidi 
Tim : fin i quo (fiyj.)(jtfi«.!ti(:.il ) 

1. Accord iruj to f. if: tor iin;.itytic studios ori(]innt(3d l)y Osgood (1957), ossontiiilly 
tfirot) major infJo()ondont dinionsiOns nndorlio tlno inodning of iill idoris, ot)iocts, 
( oncopts, otc. TfK?so riro: 

ri. Eviiluiitivo diinonsion - An id(;ci is good or t.iiid, oloan or dirty, fair or unfair, 
hcjnnst or dishone^st, hoautifuf or uqly, boliovabl(? or unbniiovtiblo. 

b. Potency dirnfjnsion - An idoa is stronc) or wnak, big or small, poworful or 
poworloss, hfjavy or licjht, 

c. Activity diin(?nsion - An idea is activf) or passivtJ, fiot or cold, fast or slow, 
alivo? or dead. 

2. JH\ connotativo mociniruj of an objoct, idon, or concept can bo mappod along 
tfio tfirof! dinionsions by using a sorios of nino or twolvo bipolar adjoctivt? scalos 
(()ood-bad, stroncj-woak, fast^skjw). 

3. Evaluativ(> dirru>nsitin bipolar adjtictivt^ scales arn usod to mf.'asurt; attitudes. Since; 
this diiTionsion accounts for ovor half of the variability in a factor analysis of the; 
moaning of concepts, reliat)l(.^ and valid coruJusions f.nn bo based on the results 

of th(; evaluative dimension scores alone . 

4. Osgood (1957) reports tost-rotest reliability coef ficien ts of .85 for morining in 
general and .91 for attitudes. In comparison with other attitude st:afes, Thurstone, 
Guttman, and Boyardus Social Distance Scales, validity coefficients of .74 to .82, 
.78, and .72 to .80, respectively, were found (Smith, 1963). 

5. A typical Sernantit. Differential, with instructions, may be found in Appendix II. 
A more thorough discussion of the' Semantic Differential Technique is found in 
Snider and Osgood (1969). 

6. Hypothetical Exarr)ple - The present investigation was conducted to deteritiine the 
feasibility of using Osgood's (1957) Semantic Differential (SD) in the evaluation 
of proposed institutional goals and objectives for staff being developed at Tinpan 
Alley Community College. Classified staff and administrators' attitudes toward 
the following 12 college objectives were compared: 

1) helping them develop a capacity for critical thinking 

2) helping them develop the ability to make independent judgments 

3) h(?lping them improve their capacity for planning 

4) helping thern improve their crecitivity 

5) helping them improve their capability for communication 
.6) helping thern with their career development 

7) helping them develop an improved capacity for earning a living 

8) helping thern improve thoir appreciation for points of view different frcm 
their own 
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fiolpiiK] llu-'fii di.'Vi'liJfi ifnf)rov»M;i ,il)ililios lor rrlcttitui \n othtM irulividii.ih. 
10) t)iii4i()in<| KiVdlvi'itHMil in tni lhrf t'(|tn..ili<)n,il tipfjoi tiiiiiti<!S 

] 1 ) iiMli/ifK) •mu.il t I irisuhd .iliofi 

\?) I iHJitiotllMI |MI tl< l| ISli )\] injMfK! 

Tfiftv iiir.,siii»»<; i)i'n(M,it»Ml Ijy tfh' ^iO m dm"; wi.tc u'lftj Id t|pti!f inin*' (!) the (|<MH!fiil 
.ittiludr n\ [Ui' two ijroups lovvjid ifm oli|<'< uvus; {?.) Ihr roltJlivn 'Viiuc" dtid "(.irilil)ilitv" 
(t)i'li<'V;il)ility. pr(,ilxibln sum of ihr olijiM tiv»'s within tsu ^i (jroup, Aud i'J) il .1 
"< o'diliihty <).jp" fxists, wh»!tbi!( thiM(' vvjs rjfioifii.iinl diftcncoci: lu'tWiMMi lh(.' two Mft^up'i. 

RSSUL TS 

Part 1 Roth I l.)S';iti(.Hl sl.ilf .itui .Hlininislrjlois |ii(li|('d thi? p' i^P<)St'd ohjoi tivris tavor.ibly. 
For ( l.issififKl st<if f. .ittituikjs wrio sinnifii .intly tiivoiiii)lif (ddioriMU fioin luMitfiihty) 
tor .ill ol))iH:tiv(!!; jfXtM'pl No. 1 1 (rcMh/in<i nquiil consirloriition). For .idimnistriitor!;, 
,initiul(js wiMi' si(|niti< lifitly fjvorabU* toi .^11 objcjctivcn (^x(;('Pt No. 4 (iinprovv cuj.itivity), 
No. 7 (ti!u^iovn t:.ip,'M:ity to Ucirn it livirKj) , No. 11 (rtMli/ioipK]iMl ( unsiduriitiuo), <ind 
No. \7 ([)n,ifTiotinq Pciriii:ipjtiv(? diH;isit)fviruikin(i). Ovi)r.ill. .idrninistriitors iiid(i(?d 
.ilf ol)i<'(:tivi!S less tc-|vorcil)ly thon classified slaft. Whon the ol)i(?(.tiv»fs w(mo r.inkod a(:(.uidiiui 
to thftir o'Lttiv*? iinpor tiHii..i) for tin? two nr<Mips, larcjo ddfrn)P('(;s wdo; found. Thi) rank 
» orrcl.ihrjn of .483 Wtis not sinnifirant. 

A/rf 2 F(jr all oI)|im tivi's. ( lassifitM j staff's "i;rndibility" st:orf^s woro hfss favoral)ln than 
"vttlijf?" scores, and sionificant dilftireoctis W(?r(; found for fiv(^ ol)j(i( tivcs. AdniiiiistraKirs' 
"rriMlibility" S(:f)r«'S worf? also Ihss favornhlt.' than "valurj" fu oros.and sifjnificanl 
ddffMiMicus worn found for six obi<H:tivos. Bntfi f.lassifi^id staff and administrators iud()od 
tlire*j obi(M:tivii5 sinnificantly k?ss cr(;dibl(i tfian valualjW?. 

2. iiiakin(| indcfpondtint jud()oni{?nts; 

4. iinprovHitj cruaiivity; 

9. improviiKj ability for rtilatind to otiior individuals. 
Parts ♦ Ovorall, ihr; administrators' "r;rodibility gaf)" scoro was hiqhor than th^j (:lassifi(?d 
staff for objt.'ctives No. 2, 3,4, 7, P., 10, 1 1 , and 12. Siynifiamt difforonais wor<' found^,^ ; 
for obitictivc No. 2 (dtivnlopinri Iht! i:cipcjialy for rnakinc) indopendont jud(irTUints) and ' 
throti othors approachod sionificanrff. Thosis api.ioarcd to bn luoro job-skill rolatod. 

DISCUSSION 

Generally, the results show that those porsons responsible for developing collogc-wlde 
(Objectives at a co-nmunity collerje face an unenviable task. First , adininistra tors, who may 
eventually be charged with implementation of the objectives, have consistently less 
favorable attitudes toward them thati do the ckissified staff. Second, the relative imf)ortan(:< 
of the objectives is greatly different for the two groups. A third indication of possible 
trouble ahe^ad arejh^j "credibility gap" scores, which indicate a cynical, "it may be good, 
but it will never wor k here" attitude. More prevalent among administrators, the scores 
may point to long-standing behavior patterns which may be difficult to change. 
In summary, the results support the continued use of the Seinantic Differential techninue 
in the measurement of altitudes toward institutional objective's. Also pointed out were 
potential problem.s caused by the conflicting positions of staff groups in the overall 
evaluation and relative importance of goals and objectives, as well as the existing 
"credibility gaps" associated with the objectives. The consistency of the results strongly 
emphasizes the discrimination and sensitivity of the SD technique in the measurement 
of attitudes. 

EXPECTED VALUE TO EDUCATORS 

Given the current emphasis on evaluation and the movement in many areas of higher 
education toward a management-by-objectives approach, it is critically important to be 
able to evaluate staff , student, and community attitudes toward proposed objectives. 
Without such an evaluation, the institution may move blindly forward, implementing 
programs to achieve objectives which have little or no probablity of success due to a 
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( t* t ;'.| 1 M{iMir,!r., fin;|i'r-.!.<hi|infj, ,ifnl sufMnirt Irv Ov^sr- frui;,! iffifi, ,rt.ji)t ')fu(ir»'t 
I ....pi,., 

III.' pfi'M'Mt Mihlv il''MiM|r,ir,ih", III.' •.. fiMtivity .iiu| m Ii i tivitv I'l .ithlnHc ifi»M',n((iM| 

hni' jlli'. O',.]! H Mr/'.rMMlitli I <l I IrliMlll.jl , III p(, jVirlUM) I I Itli dl inli)MM,|||| III t() (jtM isM iMMi.ih'l 

fnM^M|»'(i II) )h>M'«,t.ilili'.hi!irnl < it ih>,ti|i|lii xkiI ijo«il<, ,iim I m|>|i<i ttvi'S. II .issutur', tli.it , 
ntfii'i thimis hi H IX I riiM.il, .iiiitiKh's p.if.jlii'l .ind pkmIm t Im-Imvii k . thnii .ittitiMjif)<il '.tu.lh-, 

< .IN pu)vi(j»' ijst.'lu! inf*»f rn.itiun .ilx.ml the cvohilKjf) ot thf fin imoii m.^hix) fifoi i^ss jnil 
tl)f' proli.ilHlilv ut I I'SS uf I'xititii Mj f 'h iiii.im:;. 
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APPENDIX I 

informal Criteria for Attitude Statements 

1. Avoid si, )t<!tni(r)ts tfuil rn.iy lie inhjf prjittid in rnorfi Ifnin orM> way . 

2. Avoid stJitciniinlr, th.it .ir*' iri.?l()Vdnl to th»; psyrholotjir al uhjdct iukIit cunsidcrulioti. 

3. Avoid st.itnriionts tfi<il jrn likely to \n) »!ndors«Hl l)y iilmo<;l (jvoryofic or hy nlinost no oiik*. 

'1. S'l(M.t stiitooK.'Mls Ih.il iWv. l)t}li('V(}d to f oviir (lnj (;nlir(,; riuu|(( (jf tlie ijff(K:liv(J sc;tih:J of ir)lnr<:sl, 
!x Kofjp \\m) l,in(jii.if)o (jl th<; stiHorDrinls simplt;, ckMr iind direct- 
1). 5>tJt(Mf Hints sfiould short, r.irr^ly (txi^eodinf) 20 words. 

7. Ei.i<:h stHtL'rn(?nt should rontiiin only ono complete thooyht. 

8. St.JtfMiifint'j (tr)st f.lo^>sli^)ns ■ not tho choicfjs or iinswors) containing univrjrscils such as 
all, always, none, rind never ofttm introduce jfnbifjuity nnd shocild l)o avoided. 

9. Word'; r.uch jr, only, just, merely, jnd othtus ol n siiriikir ruiturfj <ih(juld b(.' usod with care 
.ind iTiudc'rriti(.)n in writing stiiternents (test (lutiStiuns). 

10. Whonevor possible, stiiteiiients should be used in the form of simple sentences rdther thiin in 
the form of conipound or corrifjlex sentences. 

1 1 . Avoid th«' usft of words thrit ni;iy not be understood by thos(( who iire to l)e (}iv(;n the (.onipUilo st:.ilt 

12. Avoid the usf> of d(UJl)Ie ne(}iittv(.'S. 

Girod. G. R.. Writing and Assessing Attitudinal Objectives, Columbus: Chyrles Merrill, 1973, p. 55. 
APPENDIX II 

The purpose of this study is to measure the fno.miny of some of the collecjc-wide objectives which 
were distributed to c)ll stiif f riiembfirs. Please make your judrjeients on the basis of what these things 
mean to you. 

At the top of each {);Kj(J of this booklet you will find a different objective to be judged. Under each 
objective Is a set of scales. Please rate each objective on each of these scales. 
Here is how you are to use these scales 

If you feel that the objective at the top of the page is very closely related to one end of the scale, you 
should place your check -rnark as follows: 

ftiir X ; . : : : : unfair 

or 

fair . : : : ; : X nnf^ilr 
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If you feel that the objective is quite closely related to on*.» or tho othfir oncl of the ncale (b'lt not 
extremely), ycu should pliK:e your check-mark follows: 

strong : X . : : . : wf^ik 

or 

strong : : : ■ '■ — ^- weak 

If the obieclivo seofjis only slightly related to one side as opposed to the other side (but is not 
iKiutral), then you should check as follows: 

active : : ^ : : ■ " [Passive 

or 

,i,;tive . : : : X : : passive 

If you consider the objective to he neutral on the scale, both sides of {ho equally associated 
with the objective, or if the scale is comp/ete// /rre/ei^ar?f. unrelated to the objective, then you 
should place your check-rnark in the middle space: 

safe : : :-K_ : : ■ dangerous 

IMPORTANT: 

(1) Place your check-marks /r? the middle of spaces, not on the boundaries: 

This Not This 

: : :_^: X : 

(2) Be sure you check every scale for every objective - do no omit any, 

(3) Never put more than one check-mark on a single scale. 

(4) Make each item a separate and independent judgment. 

Work rapidly. Do not worry about individual items. It is your first impressions, your immediate 
feelings about the items, that are important. 

The purpose of the college is to assist all members of the college staff to develop the best of their 
human potential by: helping them develop their capacity for critical thinking. 

1. Hard 

2. Foolish 

3. Honest 

4. Bad 

5. Valuable 

6. Unbelievable 

7. Strong 

8. Unsuccessful 

9. Fair 
10. Passive 



- Wise 

- Dishonest 

- Good 

- Worthless 

- Believable 

- Weak 

- Successful 

- Unfair 

- Active 
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PART 4 

Evaluation of Support Department Objectives 

Ram S win ford 



\, Introduction 

A dopiirtnififit that wiiDts to f;v,iluati.' tfifj ^'If^H livorxiss (jf its S(jrvic(?s by findintj out if it is ar:(;ornf)lisliin(j 
it?; obj<.M:liv(Ji\ may rely on infcjruuil ft.'ndh.i'.k from other tlopfirtnuints and individuals. A nioro accurate 
(jvaluation, howevfjr, involves ifie of n K'asurtMnf.Tits arid indicators. 

In the c.onl(?xl of the Parttc:t()ativ(} ^ylana^)orn('nt Projof.t, 9 measurement is dofin«?ci as any l)ohaviors 
or data which directly identify (^f fe»etiveness in achieving an obn^ctive. An indicator is defined as any 
Ijehaviors or data which indirectly itnply [Kogress in achiovfjf iient. In oth(ir words, nioasurenionts assess 
the obje(.tivf> itself, while' indi< ators asse»sti conditions, events, and outcorTios logically related to the 
objective. 

The* evaluation of an obier:tive depends in Itirtjf) part on hi.)w the objective* is written. Generally 
the less specific an object iv(?, the more that indif.ators will havf? to boused as verification of 
.iccornplishment. To derive a rnfuisurement, activities must be ciuantifiable and numbers assigned 
so that (ompiihsons f:an be inad(; between thedesired objective and the actual accomplishment. 
Each dfiparirri(int has the option of deciding which objectives can be specific, and therefore 
measurable , and which cannot, or n(;ed not, be specific. The following guidelines are offered to 
help departments make that decision by showing how an objective can be measur(?d. 

II, Writing a Measurable Objective 

The first step Is to state it clearly. A mrjasurahle objective: 

1 , focuses on results; 

2, is realistic and attainable; 

3, establishes a quantitative? standard t(^ bo achieved; 

4, defines an "audience" or those at whom service is directf;d; 

5, occurs within a specific period of Uum), 

1, Focus on results 

Initial attempts at writing objectives often produce statements that foc:us on activities rather than 
results. Activity -oriented statements describe functions rather than outcomes. Some examples of 
activity-oriented statements are: 

To develop rfM:ruitment materials for o Icier aciults. 

lo promote the economical acquisition of equipment and supplies. 

To serve as a resource agency. 

To create or assist in the productiori of instructional and/or communications media. 
To provide means of motivation and reinforcement of instructional classified staff. 

The first exaftiple is an objectivf? written by the community relations department at the administrative 
center. This statement and its subsequent revisions will serve as a model to demonstrate how an 
objective can be written so that elements leading to evaluation are "bull t in," 

The srfnf)lest way to convert the focus of the statement To develop recruitment materials for 
older adults from an activily-thf) f)rocess of developing mate rials --to a result is to ask why thf.' 
activity is being done. The answer will produce a statement that begins to focus on results: 
1st revision 

To recruit older adults as students through direct mail materials, 

2, Make it realistic and attainable 

Once the focus is on results, it is important that those results art? realistic. An objective can miss the 
mark in one of two ways: It can be written so narrowly that little energy is needed to attain it; 
or the objective can be written so that it is impossible to reach. 

The statement To recruit o/der adults as students through direct mail materials is too general for 
assessment. It implies that all recruitment of older adults can be accomplished through direct mail 
materials, which is unrealistic, A direct mail brochure is merely support for the work of college 
admissions personnel, counselors, etc. But, a brochure can carry appropriate information and encourage 
a positive response. The following statement is a realistic revision: 
2nd revision 

To gain a response to a direct mail recruitment brochure aimed at older adults. 
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3. Decide on a quantitative standard 

Thi',, i'i ihff point jt v/fii' h d' tiviii';'^ tr.infilat-.-d into nninhofs to aid in tn<jasnnMiuint . Th(i rmfnb(irs 
should r*-f.»rvu-(it .) standard of ai.hM'vr'nt-nt desired for tho ohjix :tivf'. Th»! statement To gain a response 
to a direct mat/ recruitment brochure aimed ut o/der adufts is still va()ij«' hff(,aosf; thf; d(:(in,'^* of rrjsf ionso 
is not indit at(xl and ihorf.j is no \hV\>^ Uu rniiasi.ir^Mn'fnr. 

DirH.::t-niail fnar'Mitinf] thuory maintains tfi.il a 5% r<'S[U)nso is nxf.optiunully cjood , With this bar. ktjround 
^nowUfdt)*.', Iho romtniinity njlati(jns dof )arttn^'n^!fjds to d<itr.'r min^j a oorcentacje of nisponsc; that 
will proviflf! cuKintitativ*' ovidfMK.*! of Ihi' nf ftictivmoss of the [)ro(:hiirr;s. Th(! followinc] rtJvision might 
'nitisfy tfu.'Sc rrqiwr».'nu'nts 
3rd r ovist Of) 

To gain a 4% response to a dircv t mail rtrrrijittofnt broi:hnn; aimr.d at oldur adults. 

4. Define the audience 

Support de'partm(;nts often have prt)blems defining their audionre. That audienccj could bo as larcje 
as all [«otential students in a community, or as^ifnall as offire (,o-workers. Vnry large ciroups 
must b<-d».*finefl or broken into manc»fienble fKirts so that activities can be focused and results can be 
rneasun-d. Tfir; older adu.(s in th<? stat(.*m»?nt To gain a 4% response to a direct mail recruitment 
brochure aimed at older adults nrrd further (J(ifini tion. The following rc^vision specifies th(] cjroup. 
'Ith r;:vi:>ion 

To (lain a "1% response to a din.'ct mail recruitment brochure aimed at 5,000 adults 60 years of 
age and older. 

5. Set a deadline 

The only elemofit missintj from the last revision is a deadline. The work of support departments is not 
alv/ays easily orrjani/ed ac.f:ordin() to semesters. Projects may hecjin and end at any titne. and evaluation 
may be ,in onfioiru) activity. Unless a deadline is set for achievement of a rjoal , implementation could 
be d^ayed. The followinc] revision incorporates a deadline: 
final revision 

To (}ain a 4% msponse/?/ August 1 t(j «i riirect mail rer^ruitment brochure aimed at 5,000 adults 
60 ye<irs of aqe and older. 

III. Mechanics of Measurement 

Oricej an objective is properly written, the mechanics of measurement need not be difficult. There are 

probably as many ways to derive indicators and measurements as there are support activities within the 

institution. The three types of evaluation, described on page 2 of thjs handbook are 

internal data, survejys and tests. Sup})ort departments probably wilTuse internal data most frequently, 

surveys occasionally and tests rarely in evaluation. When data for measurements must be derived from 

the audiencfi, "capturing" that audience could be a problem because of si/e, mobility and jnfrequency 

of diru'c.t contact. For this reason, cvaluatory instruments may have to be built into administrative processes 

To derive a measurement for the objective To gain a 4% response by August 1 to a direct mail 
recruitment brochure aimed at 5,000 adults 60 years of age or older, the following procedures could 
be used: 

1. Include a sel f -addressed, postage-paid response card in the brochure. Count the returns. 

2. Instruct the reader to call a special extension, i.e. extension A. Count the number of callers 
wlioask for that extension. 

3. Compare the number of these responses to the total number of brochures mailed to derive 
the pe?rcentage of response. 

The methcvs of measurement are limited only by a department's energy and available time. In most 
cases, if the statement of objective incorporates the five requirements for measurability-it focuses 
UNIVERSITV Or CA!j<?n results, is realistic, includes a quantitative standard, defines the audience and sets a deadline-the 
I Qo _«^^^f<-.ri^p^-. measurement is a logical outcome, rather than a mathematical mystery: 
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